Telegram Group & Telegram Channel
πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub



tg-me.com/machinelearning_interview/1792
Create:
Last Update:

πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub

BY Machine learning Interview




Share with your friend now:
tg-me.com/machinelearning_interview/1792

View MORE
Open in Telegram


Machine learning Interview Telegram | DID YOU KNOW?

Date: |

Telegram hopes to raise $1bn with a convertible bond private placement

The super secure UAE-based Telegram messenger service, developed by Russian-born software icon Pavel Durov, is looking to raise $1bn through a bond placement to a limited number of investors from Russia, Europe, Asia and the Middle East, the Kommersant daily reported citing unnamed sources on February 18, 2021.The issue reportedly comprises exchange bonds that could be converted into equity in the messaging service that is currently 100% owned by Durov and his brother Nikolai.Kommersant reports that the price of the conversion would be at a 10% discount to a potential IPO should it happen within five years.The minimum bond placement is said to be set at $50mn, but could be lowered to $10mn. Five-year bonds could carry an annual coupon of 7-8%.

What is Secret Chats of Telegram

Secret Chats are one of the service’s additional security features; it allows messages to be sent with client-to-client encryption. This setup means that, unlike regular messages, these secret messages can only be accessed from the device’s that initiated and accepted the chat. Additionally, Telegram notes that secret chats leave no trace on the company’s services and offer a self-destruct timer.

Machine learning Interview from it


Telegram Machine learning Interview
FROM USA